arXiv:1504.06683vl [math.OC] 25 Apr 2015 


Duality and optimality conditions in stochastic 
optimization and mathematical hnance 

Sara Biagini* Teemu Permanent Ari-Pekka Perkkio^ 

April 28, 2015 


Abstract 

This article studies convex duality in stochastic optimization over fi¬ 
nite discrete-time. The first part of the paper gives general conditions 
that yield explicit expressions for the dual objective in many applications 
in operations research and mathematical finance. The second part de¬ 
rives optimality conditions by combining general saddle-point conditions 
from convex duality with the dual representations obtained in the first 
part of the paper. Several applications to stochastic optimization and 
mathematical finance are given. 


1 Introduction 

Let {n,T,P) be a complete probability space with a filtration of com¬ 

plete sub cr-algebras of J- and consider the dynamic stochastic optimization 
problem 

minimize Ef{x,u):= J f{x{oj),u{oj),u})dP{u}) over x € M {Pu) 

parameterized by a measurable function u G P, P; R"*). Here and in what 

follows, 

A':={(xi)LoDt eL0(H,J-*,P;R"‘)}, 

for given integers rit and / is an extended real-valued B (R" x ) 0 J^-measurable 
function on M" x R™ x where n := no + ■■■+ ut- The variable x € Af is 
interpreted as a decision strategy where Xt is the decision taken at time t. 
Throughout this paper, we define the expectation of a measurable function (j) as 
-hoo unless the positive part is integrable (In particular, the sum of extended 
real numbers is defined as -l-oo if any of the terms equals -l-oo). The function 
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Ef is thus well-defined extended real-valued function on A/” x E, P; R"*). 
We will assume throughout that the function is proper, lower semicon- 

tinuous and convex for every w G n. 

It was shown in [B] that, when applied to ( |PnD , the conjugate duality frame¬ 
work of Rockafellar m allows for a unified treatment of many well known 
duality frameworks in stochastic optimization and mathematical finance. An 
important step in the analysis is to derive dual expressions for the optimal 
value function 

ip{u) := ini Ef{x,u) 

over an appropriate subspace of In this context, the absence of a duality gap 
is equivalent to the closedness of the value function. Pennanen and Perkkio [5] 
and more recently Perkkio m gave conditions that guarantee that ip is closed 
and that the optimum in dP^I ) is attained for every u € L^. The given conditions 
provide far reaching generalizations of well-known no-arbitrage conditions used 
in financial mathematics. 

The present paper makes two contributions to the duality theory for ( |P„D . 
First, we extend the general duality framework of [B] by allowing more gen¬ 
eral dualizing parameters and by relaxing the time-separability property of the 
Lagrangian. We show that, under suitable conditions, the expression in [Q The¬ 
orem 2 . 2 ] is still valid in this extended setting. This also provides a correction to 
[B] Theorem 2.2] which omitted certain integrability conditions that are needed 
in general; see [7]. Second, we give optimality conditions for the optimal solu¬ 
tions of dPuD - Again, we follow the general conjugate duality framework of m 
by specializing the saddle-point conditions to the present setting. The main 
difficulty here is that, in general, the space Af does not have a proper topo¬ 
logical dual so we cannot write the generalized Karush-Kuhn-Tucker condition 
in terms of subgradients. Nevertheless, the dual representations obtained in 
the first part of the paper allow us to write the saddle-point conditions more 
explicitly in many interesting applications. 

In the case of perfectly liquid financial markets, we recover well-known op¬ 
timality conditions in terms of martingale measures. For Kabanov’s currency 
market model with transaction costs [3], we obtain optimality conditions in 
terms of dual variables that extend the notion of a “consistent price system” to 
possibly nonconical market models. We treat problems of convex optimal con¬ 
trol under the generalized framework of Bolza much as in m- Our formulation 
and its embedding in the conjugate duality framework of m is slightly different 
from that in HZ], however, so direct comparisons are not possible. Our formu¬ 
lation is motivated by applications in mathematical finance. In particular, the 
optimality conditions for the currency market model are derived by specializing 
those obtained for the problem of Bolza. 
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2 Duality 

From now on, we will assume that the parameter u belongs to a decomposable 
space hi d which is in separating duality with another decomposable space 
y G under the bilinear form 

{u,y) = E{u-y). 

Recall that U is decomposable if 

IaU + S hi 

whenever A € T, u G U and u' G L°°; see e.g. m- Examples of such dual 
pairs include the Lebesgue spaces hi = and y — L'^ and decomposable pairs 
of Orlicz spaces; see Section [3l The conjugate of 93 : W — >■ K is the extended 
real-valued convex function on y defined by 

<p*{y) = sup{{M, y) - (p{u)}. 

u^lA 

Here and in what follows, R := R U {-foo, —00}. If ip is closecfl with respect to 
the weak topology induced on lA by y, the biconjugate theorem (see e.g. m 
Theorem 5]) gives the dual representation 

p{u) = sup{(n,y) - (p*iy)}. 
yey 

This simple identity is behind many well known duality relations in operations 
research and mathematical finance. It was shown in [9] that appropriate gen¬ 
eralizations of the no-arbitrage condition from mathematical finance guarantee 
the closedness of p. Recently, the conditions were extended in [10] to allow for 
more general objectives. 

In general, it may be difficult to derive more explicit expressions for p*. 
Following [14], one can always write the conjugate as 

p*{y) = - \ni L{x,y), 

xGJ\ 

where the Lagrangian L : A/” x y —^ R is defined by 

L{x,y) = inf {Ef{x,u) - {u,y)}. 

u£U 

We will show that, under appropriate conditions, the second infimum in 

= - inf mi{Ef{x,u) - {u,y)} 
xeJy ueu 

can be taken scenariowise while the first infimum may be restricted to the space 
of essentially bounded strategies. Both infima are easily calculated in many 
interesting applications; see [ 6 ] and the examples below. 

convex function is closed if it is lower semicontinuous and either proper or a constant. 
A function is proper if it never takes the value —00 and it is finite at some point. 
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Accordingly, we define the Lagrangian integrand on K" x K™ x 17 by 
l{x,y,uj) := ini {f{x,u,uj)-u-y}. 

u£k'^ 

We will also need the pointwise conjugate of /: 

f*{v,y,uj) : = sup {x ■ v + u ■ y - f{x,u,uj)} 
a:eR",«eR’" 

= snp {x ■ V — l{x,y,uj)}. 
xeR" 

By [181 Theorem 14.50], the pointwise conjugate of a normal integrand is also 
a normal integrand. Clearly, I is upper semicontinuous in the second argument 
since it is the pointwise infimum of continuous functions of y. Similarly, 

l{x, y, uj) := sup {x ■ v - f*{v, y, w)} 

ueR" 

is lower semicontinuous in the first argument. In fact, !(•,?/, w) is the biconju¬ 
gate of l{-,y,uj) while —l{x,-,uj) is the biconjugate of —l{x,-,oj)-, see [131 The¬ 
orem 34.2]. The function (x,uj) l{x,y{ui),ui) is a normal integrand for any 
y G y while {y,uj) i—>■ —l{x{uj),y,uj) is a normal integrand for any x G Af 
and thus, the integral functionals El and El are well-defined on Af x y (re¬ 
call our convention of defining an integral as -l-oo unless the positive part 
of the integrand is integrable). Indeed, we have l{x{uj),y,uj) = —h*{y,uj) 
for h{u,uj) := f{x(u!),u,uj), where h is a normal integrand, by [HI Proposi¬ 
tion 14.45(c)]. Similarly for 1. 

Restricting strategies to the space Af°° C A/" of essentially bounded strategies 
gives rise to the auxiliary value function 

(fiu)= inf Ef{x,u). 

Under the conditions of Theorem [5] below, the conjugates of and (p coincide, 
or in other words, closures of (p and p are equal. The following lemma from [lOj 
will play an important role. We denote 

:= {„ G L^{n,T, R”) \E{x-v)= 0 VxG Af°°}. 

Lemma 1. Let x G Af and v G Af^. If E[x ■ u]’*' G , then E{x ■ v) = 0. 

We will use the notation 

domi Ef := {x G Af \3u G hi : Ef{x, u) < -|-oo}. 

Recall that algebraic closure, aclC, of a set C is the set of points x such that 
{x, zj C C for some z G C. Clearly, C C acl C while in a topological vector 
space, aclC C clC. 
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Theorem 2. If dort\El{-,y)r]N°° C acl(domi i?/fl then 

(p*{y) = - inf El{x,y). 

If, for every x G J\f°° with x € c\ domi / almost surely, there exists x G M°° 
with X G rint domi / almost surely and {x, x) G domi Ef, then 

‘f*iy) = - inf El_{x,y). 

We always have 

< I}*{y) < inf Ef*(v,y). 

In particular, if there exists v G A/’'*' such that <p*{y) = Ef*{v,y), then 

(p*{y) = (p*iy). 

Proof. By the interchange rule ([HI Theorem 14.60]), L{x,y) = El{x,y) for 
X G domi Ef and thus, 




inf Lix.y) = inf 

x€A/*°°ndomi Ef 

inf El(x^y) > inf 

ai€A/*°°ndomi Ef x£ff°‘ 


L{x,y) 

El{x,y). 


The converse holds trivially if dom El{-,y) riAf°° ^ 0. Otherwise, let a G K and 
X G N'°° be such that El{x,y) < a. By the first assumption, there exists an 
x' G domi Ef n Af°° such that (1 — X)x + \x' G domi Ef for all A G (0, Ij. By 
convexity, L((l — A)i + Ax', y) = EI{{1 — X)x + Ax', y) < a for A small enough 
and thus 

-f,*{y)= inf El{x,y). 

To prove the second claim, let y G and x G dom.El(-,y) By [HI 

Theorem 34.3], x G cl domi / almost surely so, by assumption, there exists 
X G with X G rint domi / almost surely and (x,x) G domi i?/. Thus, 
X G acl domi Ef so the first domain condition is satisfied. By [H Theorem 6.1], 
(x, x) C rint domi /, and thus by the same line segment argument as above, the 
infimum in 

-ip*{y)= inf El{x,y) 

x^AJ°° 

can be restricted to those x for which x G rint domi /. Then, by [H Theorem 
34.2], we may replace I by I without affecting the infimum. 

As to the last claim, the Fenchel inequality gives 


/(x, u) + f*{v,y)>x-v + u-y. 

Therefore, for (x, u) G domi?/ and v G Af^ with Ef*{v,y) < 00 , we have 
E{x • x) = 0 by Lemma in so we get 

ip*{y)= sup E[u-y-f{x,u)]< inf Ef*{v,y). 

xGAf,u&U wSTV-L 
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Since if > f, have f* < f* ■ This completes the proof of the inequalities. The 
last statement concerning the equality clearly follows from the inequalities. 

□ 

Theorem [2] gives conditions under which the conjugate of the value function 
of dPuD can be expressed as 

f*{y)= inf El{x,y). 

The second part gives conditions that allow one to replace ^ by Mn the above 
expression. One can then resort to the theory of normal integrands when calcu¬ 
lating the infimum. It was shown in that this yields many well-known dual 
expressions in operations research and mathematical finance. Unfortunately, 
the proof of the above expression in 0 Theorem 2.2] was incorrect and the 
given conditions are not sufficient in general; see [7]. The following example 
illustrates what can go wrong if the condition on the domains is omitted. Here 
and in what follows, 5c denotes the indicator function of a set C: 5c{x) equals 
0 or -1-00 depending on whether x £ C ot not. 

Example 3. Let Pq trivial, riQ = 1, U = L°°, y = ^ € L'^ be such that 

/3+ and j3~ are unbounded, and let 

f{x, u, uj) = 5r_ (/3(w)a:o -I- u) 

so that dom Ef = {x S A/” | xq = 0} x f* = 5^^^ and 

l{x,y,uj) = yP{uj)xo - Sw+iy)- 

Fory = /3+, we get inf^-gj^^oo El(x, y) = —oo while f*{y) = 0. Here dom El{-, y) = 
N, so the first condition in Theorem\^is violated. 

The following example shows how the equality f* = (p* may fail to hold 
even when the first condition of Theorem [5| is satisfied. 

Example 4. Let T = \, n = 2, Eq is the completed trivial a-algebra, and 

f{x,u,uj) = |xo - 1| + dR_(a(a;)|xo| - Xi) d- 

where a € L°(Pi) is positive and unbounded. It is easily checked that with 
lA = y = L? the first condition of Theorem\^ holds but (p{u) = 1-1- and 

f{u) = uur. 

At the moment, it is an open question whether the algebraic closure in 
the domain condition could be replaced by a topological closure. This can 
be done, however, e.g. if El{-,y) is upper semicontinuous on the closure of 
domi Ef n A/””®. Also, in the deterministic case (where P is integer-valued on 
E), the first condition is automatically satisfied since domZ(-, y) C cldomi / for 
all y, by [131 Theorem 34.3]. 

The following describes a general situation where the assumptions of Theo¬ 
rem [2] are satisfied. 
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Example 5. Consider the problem 


minimize E/q^x) over x G J\f 

subject to fj{x) < 0 P-a.s., j = 1,... ,m, 


where fj are normal integrands. The problem fits the general framework with 


fo{x,uj) if fj{x,uj) +Uj <0 for j = 1 ,... ,m, 


f{x,u,u}) = 


+00 otherwise. 


This model was studied in Rockafellar and Wets m who gave optimality con¬ 
ditions in terms of dual variables. We will return to optimality conditions in 
the next section. For now, we note that if fj{x) G lA for all x G and 

j = 0,... ,m, then the assumptions of Theorem\^ are satisfied. 

Indeed, domi EfC\M°° = so the first two conditions in Theorem\^hold. 
The lagrangian integrand can now be written as 


m 



By 13} Theorem 22], the function El{-,y) is Mackey-continuous (with respect 
to the usual pairing of L°° and L^) at the origin of L°° for every y Gy so, by 
convexity, the function 


<f>y{x) := inf El{x-\-x,y), 

'r C- Kf°° 


is Mackey-continuous as well; see e.g. m Theorem 8J. By m Theorem 11], 
this implies that (py has a subgradient at the origin, i.e. a v G such that 

El{x -\-x,y) > (j)y{Q) + E{x ■ v) Vi G L°°, x G A/’°° 

or equivalently 

El{x, y) > (0) + E((i — a;) • u) Vi G L°°, x G 

This implies v G and infjgioo E[l{x,y) — i • u] = 4>y(0). By the inter¬ 
change rule fU8l Theorem If.60]), this can be written as —Ef*(v,y) = 0y(O) = 
—(p*{y), so the last condition of Theorem\^ holds. 

Section 4 of [5] studied financial models for pricing and hedging of portfolio¬ 
valued contingent claims (claims with physical delivery) along the lines of Ka¬ 
banov [3] ; see Example [12] below. The following example is concerned with the 
more classical financial model with claims with cash-delivery. 

Example 6. Consider the problem 


minimize 



over X G N, 


(ALM) 
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where V convex normal integrand ott. K x such that is nondecreasing 

nonconstant and V{Q,uj) = 0. This models the optimal investment problem of 
an agent with financial liabilities u G U and a “disutility function” V. The 
J-t-measurable vector st gives the unit prices of “risky” assets at time t and the 
vector Xt the units held over {t,t + 1]; see e.g. Rdsonyi and Stettner Ul^ and 
the references therein. 

Assume that, for every x G , there is au GlA such that EV{u — Y^J^q Xf 
As(_|_i) < oo, then the closure of the value function ip of (lALMI) has the dual 
representation 


{d<p){u) = sup E[uy -V*{y)], 
yeQ 


where Q is the set of positive multiples of martingale densities y G y, i.e. 
densities dQ/dP of probability measures Q P under which the price process 
s is a martingale. 

Indeed, (lALMI) fits the general model ( |PmD with 


T-l 


f{x,u,ui) = V ^-'^Xf Ast+i(a;),a;j , 

T-l 

-y^Xf Ast+i(a;) 

f*{v,y,uj) = 




if vt = - 2 /Ast+i(w) for t <T and vt = 0, 
+00 otherwise. 


The integrability condition implies domi Ef n = J\f°° so the first two con¬ 
ditions of Theorem hold. Thus, 


-T*{y)= inf El{x,y) =-EV*{y) + inf E 

x^N°° x^N°° 


T-l 

^ Xt ■ (yAst+i) 

i=0 


By Fenchel inequality. 


T-l / T-l \ 

uy-^^Xf (yAst+i) < ^ I u - ^ I + V^iv) P-a.s. 

\ / 

where for every x G and y G AovuEV*, the right side is integrable for 

some u GU. Thus, ' {v^st+i) is integrable for every x G and 

y G dovuEV*. Therefore the last infimum equals —oo unless Et{yAst+i) = 0 
for every t, i.e. unless y G Q. Moreover, if y G dom(^* then Ef*{v,y) = (p*{y) 
holds with Vt = j/Ast+i for t < T and vt = 0, so the last condition of Theorem\^ 
holds. 

The following example addresses a parameterized version of the generalized 
problem of Bolza studied in Rockafellar and Wets m 
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Example 7, Consider the problem 


T 

minimize Kt{xt, Axt + Ut), (1) 

where rit = d, Axt := x* — Xt-i, x_i := 0 and each Kt is an Et-measurable 
normal integrand on x x 

We assume that, for every x G J\f°° with xt G cl domi Kt for all t, there 
exists X G with x* G rintdomi Kt for all t and (x,x) G domi Ef, and that 
‘^u &IA and °‘y & y for every u € U and y G y, where °‘Ut = EtUt- Then the 
closure of the value function ip of © has the dual representation 

T 

{c\ip){u)= sup ES^lut ■ yt - Kf{EtAyt+i,yt)] 
yeyn^ ^ 

for every adapted u GU. 

Indeed, the problem fits our general framework with 

T 

f{x,u,uj) = 

T 

l{x,y,uj) = ^ [-Xt • Ay^+i ^ Ht{xt,yt,uj)] , 

T 

f%v,y,u;) =^K*{vt-\-Ayt^i,yt), 
t=0 

where u = (ug, ■ ■ ■, ut) with ut G R'^ and 

Ht{xt,yt,u}) := inf {Kt{xt,ut,uj) - Ut ■ yt} 

utGR'^ 

is the associated Hamiltonian. 

The domain condition in Theorem H is satisfied^ so 

T 

-ip*{y)= inf El{x,y)= inf E^[-xt ■ Ayt+i + Ht[xt,yt)], 

t^O 


where IIt{xt,yt,u!) = sup„^{ut • Xt — Kf{vt,yt,u!)}- Thus, by the interchange 
rule \18[ Theorem 14-50], 


T 

-T*{y) = - inf Ey^ [-xt ■ EtAyt+i + Ht{xt,yt,uj)] 

xGN°° 

t^O 

T 

= -EY,K*t{EtAyt+i,yt) 
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for adapted y. Moreover, with vt := EtAyt+i —Ayt+i we get (p*{y) = Ef*(v, y), 
where v € A/"'*'. The last condition in Theorem\^thus holds. For any y, Jensen’s 
inequality gives 


-T*{y)= inf El{x,y) 

x^N°° 

T 

- M EtAyt+i+Ht{xt,Etyt)] 

t^O 

= -tCv)- 


Therefore, for adapted u, we get 


T 

cl(p{u) = sup E'Y'lut ■ yt - Kf{EtAyt+i,yt)]. 
ysynX ^ 

The dual representation of the value function in Example [3 was claimed to 
hold in under the assumption that the Hamiltonian is Isc in x. The claim is, 
however, false in general since it omitted the domain condition in Theorem [3 
The integrability condition posed in Example 0 not only provides a sufficient 
condition for that, but it also makes the lower semicontinuity of the Hamiltonian 
a redundant assumption. 


3 Optimality conditions 

The previous section as well as the articles [i I were concerned with dual 
representations of the value function cp. Continuing in the general conjugate 
duality framework of Rockafellar [14] , this section derives optimality conditions 
for JPmD by assuming the existence of a subgradient of (p at u. Besides optimality 
conditions, this assumption implies the lower semicontinuity oi tp at u (with 
respect to the weak topology induced on U by y) and thus, the absence of a 
duality gap as well. Whereas in the above reference, the topology of convergence 
in measure in Af played an important role, below, topologies on Af are irrelevant. 
Recall that a y G y is a subgradient of (p at u GU if 

>p{u') > >p{u) + {u' — u, y) t/u' G lA. 

The set of all such y is called the subdifferential of ip at u is and it is denoted 
by dp{u). If dp(u) 0, then p is lower semicontinuous at u and 

p{u) = {u,y) - p*{y) 

for every y G dp{u). By |141 Theorem 11], dp{u) 0, in particular, when p is 
continuous at u. 

We assume from now on that Ef is closed in u and that p is proper. 
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Theorem 8. Assume that dip(u) ^ 0 and that for every y £ dip{u) there exists 
V £ such that (p*{y) = Ef*{v,y). Then an x € Af solves ( |Pm[ ) if and only 
if it is feasible and there exist y G y and v £ such that 

{v,y) £ df{x,u) 

P-almost surely, or equivalently, if 

V G dxl{x,y) and u G dy[—l]{x,y) 


P-almost surely. 

Proof. Note first that ii y G d(p{u) and v G Af^ such that ip*{y) = Ef*{v,y), 
then Lp{u) + ip*{y) = {u,y) and 

M Ef{x,u) = {u,y)-(p*{y) = E[u ■ y - f*{y,v)]. 

x€.Af 

Thus, X solves JPuP if and only if 

E[f{x, u) + f*{v, y)] = E[u ■ y]. 


By Fenchel’s inequality, 


f{x, u) + f*{v,y)>x-v + u-y, 

so, by Lemma[Tl E[x-v\ = 0 for every feasible x. Thus, x solves dP^D if and only 
if X is feasible and the above inequality holds as an equality P-almost surely, 
that is, if 

{v,y) G df{x,u) 

P-almost surely. By [Ml Theorem 37.5], this is equivalent to 
v G dxl{x,y) and u G dy[—l]{x,y) 


P-almost surely. 


□ 


Example 9. In Example\^ the optimality conditions of Theorem\^ mean that 


fj{x) P Uj < 0, 

m 

X G argmin{/o(z) -f ^ Vjfjiz) - z-v}, 
zeR" 

Vj > 0 

P-almost surely. These are the optimality conditions derived in m, where suf¬ 
ficient conditions were given for the existence of an optimal x G Af°° and the 
corresponding dual variables y G y and v G A/”"*" (in our notation); see 1761 
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Theorem 1], The conditions of U&j imply the continuity of the optimum value 
at the origin with respect to the L°° -norm. This yields the existence of dual 
variables in the norm dual They then used the condition of “relatively 

complete recourse” to show that the projections of the dual variables to the sub¬ 
space C (L°“)* satisfy the optimality conditions as well. 

We will now describe another general setup which covers many interesting 
applications and where the subdifferentiability condition dtpiu) 0 in Theo¬ 
rem [8] is satisfied. This framework is motivated by Biagini [I] , where similar 
arguments were applied to optimal investment in the continuous-time setting. 
The idea is simply to require stronger continuity properties on ip in order to get 
the existence of dual variables directly in y (without going through the more 
exotic space (L°°)* first as in [l6]l. 

A topological vector space is said to be barreled if every closed convex ab¬ 
sorbing set is a neighborhood of the origin. By [H Corollary 8B], a lower semi- 
continuous convex function on a barreled space is continuous throughout the 
algebraic interior (core) of its domain. On the other hand, by [l4l Theorem 11], 
continuity implies subdifferentiability. Frechet spaces and, in particular, Banach 
spaces are barreled. In the following, we say that U is barreled if it is barreled 
with respect to a topology compatible with the pairing with y. 

The following applies Theorem [5] to optimal investment in perfectly liquid 
financial markets. 

Example 10. Consider Example\^ and assume thatU is barreled, EV is finite 
on U and EV* is proper in y. Then an x G Af solves (lALMI) if and only if it 
is feasible and there exists y G Q such that 

T-l 

y ^dV{u-'^Xf Asi+i) P-a.s. 
t^o 

Proof. By [Mj Theorem 21], EV is lower semicontinuous so by [Ill Corol¬ 
lary 8B], it is continuous. Since 

p{u)<Ef{0,u) = EV{u), 

[Til Theorem 8] implies that p is continuous and thus subdifferentiable through¬ 
out 14, by m Theorem 11]. Moreover, p*{y) = Ef*{v,y) for every y G domyi* 
and V G given by Vt = yAst+i. The assumptions of Theorem [8] are thus 
satisfied. The subdifferential conditions for the Lagrangian integrand I can now 
be written as 


Vt = —yAst+i P-a.s. for t < T and vt = 0, 

T-l 

u-'^Xf Asi+1 e dv*{y) P-a.s. 

Since v G A/”"*", the former means that y G Q while the latter can be written in 
terms of dV as stated; see [TH Theorem 12]. □ 
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The optimality conditions in Example [TU] are classical in financial mathe¬ 
matics; for continuous-time models, see e.g. Schachermayer m or Biagini and 
Frittelli [2] and the references therein. 

The next example applies Theorem |5] to the problem of Bolza from Exam¬ 
ple 0 It constructs a subgradient y S d(p{u) using Jensen’s inequality. 

Example 11. Consider Example^ and assume that Li is barreled and that there 
exists a normal integrand 9 such that E9 is finite on U, E9* is proper on y, 
and, for every u € U f] N, 

T 

^^Kt{xt, Axi + ut) < 9{u) P-a.s. 
for some x G Af. Then an x G M solves 


minimize 

xGAf 


T 

E'^Kt{xt,Axt -\-ut) 


for a u GldnAf if and only if x is feasible and there exists y & y C\M such that 


{EtAyt+i,yt) S dKt{xt,Axt + Ut) 


P-almost surely for all t, or equivalently, if 

EtAyt+i G d,^Ht{xt,yt), 

Ut + Axt G dy[-Ht]{xt,yt) 


P-almost surely for all t. 

Proof. The space U C Af is a barreled space and its continuous dual may be 
identified with y Ci Af. Indeed, by Hahn-Banach, any y € {U H Af)* may be 
extended to a y G 3^ for which “y G ycAf coincides with y on U f\Af. Moreover, 
for any closed convex absorbing set B in U C Af, we have that B = {u G U \ 
°‘u G i?} is a closed convex absorbing set in U, so it is a neighborhood of the 
origin of U which implies that B n A/" C i? is a neighborhood of the origin of 

ur\Af. 

By assumption, for every u &U CAf there is an a; G A/” such that 

T 

(p{u) < E'^KtixtjAxt -\-Ut) < E6{u). 

By [m Theorem 21], Ed is lower semicontinuous so by [HI Corollary 8B], it is 
continuous. Thus, y? is continuous and in particular, subdifferentiable onUC\Af 
(see [m Theorem II]) so for every u ^UCAf there is a y G 3^ n A/" such that 

p{u') > <p{u) -\- {u' — u, y) Mu' r\ Af. 
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Since each Kt is J^t-measurable, Jensen’s inequality gives 

(p{u') > > ip{u) + {“u' — u,y) = ip{u) + {u' — u,y) V m' S U, 

so y € dip{u) as well. Moreover, as observed in Example [3 we have Ef*{v, y) = 
(p*{y) for vt = EtAyt+i — Ayt+i- The subdifferential conditions in Theorem [5] 
for the Lagrangian integrand I become 


Vt + Ayt+i G dxHt{xt,yt) P-a.s. Vt, 
ut + Axt G dy[-Ht]{xt,yt) P-a.s. Vt. 

By [131 Theorem 37.5], these are equivalent to the conditions in terms of Kt- □ 

The optimality condition in terms of Kt in Example [TT] can be viewed as 
a stochastic Euler-Lagrange condition in discrete-time much like that in [m 
Theorem 4]. There is a difference, however, in that [13 studied the problem of 
minimizing E'^ Kt{xt-i, Axt) and, accordingly, the measurability conditions 
posed on the dual variables were different as well. The condition in terms of 
Lit can be viewed as a stochastic Hamiltonian system in discrete-time; see [121 
Section 9] for deterministic models in continuous-time. Our assumptions on the 
problem also differ from those made in m- Whereas the assumptions of 
and the line of argument follows that in [16] (see Example |3)), our assumption 
implies the continuity of ip on the adapted subspace U fl N. 

It is essential that the growth condition in Example [TT] is required only for 
adapted u G U. Indeed, since x is adapted, it would often be too much to ask 
the upper bound for nonadapted u. This is the case e.g. in the following example 
which is concerned with the financial model studied in BM- The model is an 
extension of the currency market model introduced by Kabanov [3]; see also 
Kabanov and Safarian [3]. 

Example 12. Consider the optimal investment-consumption problem 


T 

minimize E''^^Vt{—kt) over {z,k)Gj\f 

t=o 

subject to Azt -\- Ut -\- h G Ct, zt = 0 P-a.s. t = 0,..., T, 


(OCP) 


where Z-i := 0, and for each t, Ct : Ll ^ is Pt-nT-ettsurabl^ and closed 
convex-valued with 0 G Ct and Vt is an Pt-‘measurable nondecreasing (wrt 
convex normal integrand with Vj(0) = 0. 

We will assume as in Example^ that adapted projections of the elements of 
U and y stil belong to U and y, respectively. We also assume that U is barreled 
and that there exists a normal integrand 9 such that E6 is finite on lA, E9* is 
proper on y, and that 


Vj' 



< 9{u) 


Vit G 


is J^t-measurable if {cj E H | Ct(cj) n O 7^ 0} E for every open O. 
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Then (z, k) G J\f solves (lOCPI) for u GU fl A/” if and only if {z, k) is feasible and 
there exists a martingale y Gy such tha^ 

-ktG dVfiyt), 

Azt +ut + kt G dact (yt) 

P-almost surely for t = 0,... ,T. When Ct are conical, the last condition means 
that 

Azt -\- ut -\- kt G Ct, yt & Cf, {Azt + ut + kt) ■ yt = 0 

P-almost surely for t = 0,... ,T. Thus, y generalizes the notion of a “consistent 
price system” introduced in m to nonconical market models; see m- 

Proof. Problem (lOCPI) can be expressed in the format of Example [Tl] with 
X = [z, k), u = {u^, u^) and 

Kt{xt,ut,uj) = Vt{-kt,oj) + Sc,(uj){ut + kt) t = 0,...,T -1, 
Kt{xt,ut,uj) = Vri—kTjUj) + 5ct(uj){ut + ^t) + <^{o}(2:t)- 

The Hamiltonian becomes 


Ht{xt,yt,uj) = (5{o}(2/f) + h ■ y^ + Vt{-kt,uj) - crc,(a:){yD t = 0,...,T-l, 
HT{xT,yT,uj) = ^{o}(yf) + kr -yr + VT{-kT,uj) - + <J{o}(2:t)- 

We are in the setting of Example [3 since the domain condition is satisfied by 
X = (0, k) for any x G where fct = 1 for all t. 

Given u GU CiAf, we have 

Kt{xt,Axt -\-Ut,u}) = Vt 
t=o \t=o 

where x" = ( 2 :“, fc“) G Af is defined by Azt = —Ut, fc" = 0 for t < T and zlf = 0 
and klf = Thus, the assumptions of Example ITT] are satisfied with 

y = 0 and /3 = 0. The given optimality conditions are just a special case of 
the optimality conditions in Example If II Indeed, the subdifferential conditions 
become 


E 


^ < 0{u), 


Zt = 0 and EtAy^^.^ = 0 Vt = 0, ...,T — 1, 

EtAy^+, G yt - dVt{-kt) V t = 0,..., T, 
ul + Azt G -kt + dacAvt) V t = 0,..., T, 

j/f = 0 vt = o,...,r. 

The first condition means that y^ is a martingale and zy = 0. The second and 
the last condition mean that = 0 and yf G dVt{—kt). By [13 Theorem 12], 
the subdifferential condition can written as —kt G dVf{yt). □ 

^Here, crct (yt) ■= supfz ■ yt\z G Ct}- 
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